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O 
(N 



Michael Mullan^'^ and Emanuel Knill^'^ 

^National Institute of Standards and Technology 

^University of Colorado at Boulder 

(Dated: July 28, 2011) 

The accuracies of modern quantum logic clocks have surpassed those of standard atomic fountain 
clocks. These clocks also provide a greater degree of control, because before and after clock queries, 
we are able to apply chosen unitary operations and measurements. Here, we take advantage of these 
choices and present a numerical technique designed to increase the accuracy of these clocks. We 
use a greedy approach, minimizing the phase variance of a noisy classical oscillator with respect 
to a perfect frequency standard after an interrogation step; we do not optimize over successive 
interrogations or the probe times. We consider arbitrary prior frequency knowledge and compare 
clocks with varying numbers of ions and queries interlaced with unitary control. Our technique is 
based on the semidefinite programming formulation of quantum query complexity, a method first 
developed in the context of deriving algorithmic lower bounds. The application of semidefinite 
programming to an inherently continuous problem like that considered here requires discretization; 
we derive bounds on the error introduced and show that it can be made suitably small. 
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I. QUANTUM CLOCKS 
A. The Clock Protocol 

Most atomic clocks are designed to lock a noisy clas- 
sical oscillator to the resonance of an atomic standard. 
Typically, this is accomplished via the following clock in- 
terrogation protocol: 

1. Preparation: The atomic system is prepared in 
some initial state. 

2. Query: The classical oscillator and the atomic 
system interact. This modifies the atomic state 
in some way that depends on both the resonant 
atomic frequency ujq and the frequency of the clas- 
sical oscillator u. 

3. Measurement: The atomic system is measured 
and provides some information about uj — ujq. 

4. Correction: The classical oscillator is adjusted 
based on this information, ideally reducing \uj — ujo\. 

This protocol must be repeated indefinitely, as the noisy 
classical oscillator drifts over time. Furthermore, the in- 
formation gained in step [3] is always incomplete. Conse- 
quently, the frequency of the classical oscillator is never 
known exactly and must be described by a probability 
distribution. Figure [l] illustrates how this distribution 
changes as the clock is run. In this probabilistic per- 
spective, our goal is to maximize our knowledge of the 
classical oscillator. For the purpose of maintaining an 
accurate clock, we minimize the phase variance of the 
classical oscillator with respect to the atomic frequency 
standard by optimizing over state preparation (step [l]) 
and the post-query measurement (steplsl). We also con- 
sider interrogations consisting of multiple queries inter- 
laced with unitary control. 

A more complete characterization of a clock involves 
estimating the total time difference between the clock 
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FIG. 1: Evolution of the classical oscillator's probability dis- 
tribution in a clock protocol. Noise decreases our knowledge 
of the classical oscillator's frequency, widening p{uo). The 
prior probability distribution on the right is used in our op- 
timization procedure, and describes the average frequency of 
the classical oscillator over the probe time T. A measure- 
ment of the atomic standard then yields a measurement out- 
come a, which can be used to compute the posterior distribu- 
tion p(u\a). Over many iterations of this procedure, we gain 
knowledge of the history of the frequency differences. This 
history can be integrated to estimate the total time difference 
between the classical oscillator and an ideal atomic clock. 



and an ideal clock based on the atomic standard since 
the clock was started. The time difference is measured 
in terms of the total phase difference and requires in- 
tegrating the frequency differences over time. A full 
Bayesian treatment of this characterization problem re- 
quires that we maintain the complete history of the clas- 
sical oscillator by way of the joint probability distribu- 
tion, p{uji^uj2 ' • -oJt)^ where the marginals p{oJi) reflect 
our knowledge of the classical oscillator at a specific time 
in the past. However, in this paper we use a greedy 
approach, namely our optimization procedure does not 



take into account this history, and our prior knowledge 
consists only of the marginal p{uJt). 



Except for a brief discussion in Sect. |IID] we ignore the 
effects of decoherence on the atomic standard and con- 
sider only random fluctuations of the classical oscillator's 
frequency. We focus on clocks with relatively few atoms 
and assume full quantum control of the atoms. These 
clocks are often referred to as quantum clocks. An ex- 
ample is the highly accurate Al^ quantum clock at NIST 
[1] , which is a candidate for the application of the tech- 
niques developed here. 

We consider a simplified model of an A/'-atom clock, 
whose state is a superposition of the A' + 1 symmetric 
Dicke states |0), . . . , lA') of A^ identical two-level systems. 
For example, if A" = 2, the Dicke states are given by |0) = 

|00)^B> 11) = (|01)^B + |10)^b)/V2, and |2) = |11)^^. 
Ref. [2] shows that nothing can be gained by considering 
other states of the two-level systems. The A" atoms begin 
in the state |0)(0| and are then initialized (step 1) by 
the application of a unitary operator U{0) to the state 
p{0) = U{0)\0){0\U{Oy. A query (step[2| consists of the 
application of a second unitary operator that depends on 
both u and uq; normally, this dependence is only on the 
difference uj — ujq. Then 

p(o) -^ p{oy = n{uj - ujo)p{o)n{uj - uoy. (i) 

Finally, the system is measured (step Isl) with a positive 
operator- valued measure (POVM) {Paja- 

Interrogation is often done via the Ramsey tech- 
nique [2. Here, the atoms are subject to two pulses from 
a classical oscillator of frequency cj, separated by a pe- 
riod of free evolution of length T. These pulses are short 
enough for their dependence on uj to be neglected, and 
so for our purposes, their effect can be absorbed into the 
definitions of U{0) and {Pa} a- The period of free evolu- 
tion is equivalent to a z rotation by an angle of {uj — ujo)T. 
Thus, Q{uj — uJo) in Eq. ^ is given by 



Q{(jO — UJq) 






(2) 



where J^ is the total z angular momentum operator, 
Jz\k) = {k — N/2)\k). By making a global phase change, 
we can write the evolution of the Dicke states as 
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\k). 



(3) 



Without loss of generality, for the remainder of this paper 
we assume that uq = 0. 

We refer to the action in Eq. ([l]) as a "clock query". 
We can generalize such an action by combining multiple 
queries with interlaced unitary operators. The final clock 
state can then be written as 

p{tf) = n{uj)u{tf)...n{uj)u{i) 

X p{o)u'^ {i)Q{uy . . . u{tfyQ{ujy, (4) 

provided that the relative frequencies do not drift be- 
tween steps 1 and tf. We refer to the complete action in 



Eq. Q as a "clock interrogation". As written, U{t) acts 
only on the clock's atoms; below, we consider U{t) that 
can also act on arbitrary ancilla atoms. Our goal is to 
minimize the expected cost 



(C) = C{uj - fa)p{a\uj)p{uj)dujda 

= j j C{UJ- fa)iT{PaPu:{tf))p{uj)dujda. (5) 

Here, fa is the classical frequency estimate for measure- 
ment outcome a with associated POVM operator P^, 
p{(jj) is the prior probability distribution of the classi- 
cal oscillator's frequency, and p{a\uo) is the probability of 
measurement outcome a given uo and the interrogation 
protocol. The subscript uj oi p indicates that the clock 
was interrogated by a classical oscillator at frequency uo. 
If C{uj — fa) = {'^ — faYi then a minimization of (C) 
is equivalent to a minimization of the expected posterior 
variance of the relative phase change ujT. To minimize 
(C) we vary the U{t) in Eq. Q and the final POVM 
{Pa}a' The operator Vt{uj) is considered fixed. 

In principle one can consider simultaneously optimiz- 
ing multiple sequential interrogations with varying probe 
times T. Because a fixed probe time is unable to distin- 
guish between frequencies differing by multiples of 27r/T, 
varying the probe time is necessary to avoid undetected 
frequency hops. Here, we consider only one interrogation 
at a time and fix the probe time T. In this case, there 
is a scaling symmetry uj -^ auj and T -^ uj/a^ so we fix 
T = 1 from now on. 



B. Background and Summary 

A great deal of research has been done on the theory 
of atomic clock optimization. Of particular interest has 
been the question of how quantum effects such as en- 
tanglement and squeezing can help overcome the atomic 
shot-noise precision limit of 0{1/\/N) and approach the 
Heisenberg limit of 0{1/N) for A" atoms. The possi- 
bility that these effects can result in improved precision 
was raised in [H |5]. These and related ideas are now 
at the foundations of the subject of quantum metrol- 
ogy [6 . Our work is based on and extends the analyt- 
ical studies of Buzek et al. |2^, who sought to optimize 
clock interrogations under the assumption of a uniform 
prior and a family of periodic cost functions. Starting 
from results of Holevo [7 , they obtained a family of ini- 
tial states that perform well for large numbers of atoms. 
Recently, Demkovicz-Dobrazanski [8] optimized interro- 
gations with costs determined by the periodic function 



C{uj - fa) = 4 sin' 



2 (Uj-fa) 



for arbitrary continuous pri- 



ors. While this approach is largely analytical, its im- 
plementation requires the numerical maximization of a 
trace norm. These works focus on optimizing a single 
interrogation. Long-term stability has been analyzed for 
entangled states of a number of atoms in Ref. [9 , and 



for a family of squeezing protocols of atomic ensembles 
in Ref. [10]. These studies account for phase noise in 
the classical oscillator and optimize clock protocols given 
specific feedback mechanisms and noise models. 

The periodic cost functions studied in p| [8] are con- 
venient for analytic studies of clock optimization but do 
not penalize phase errors greater than 27r, even though 
they correspond to frequency estimates far from the true 
frequency of the oscillator. This issue becomes impor- 
tant when multiple interrogations and long-term clock 
stability are considered. Given that we do not explic- 
itly consider either, and that in the model described 
above, phases differing by multiples of 27r cannot be dis- 
tinguished, this may seem irrelevant. Specifically, when 
optimizing interrogations consisting of one query or mul- 
tiple queries with identical probe times as we do here, 
the prior and the cost function can in principle be folded 
into the interval [— 7r,7r]. However, this folding results in 
a cost function that depends on the prior. Because of this 
and in view of future extensions of this work, we consider 
non periodic cost functions, particularly the quadratic 
one. 

The goal here is to apply the semidefinite program- 
ming strategy originally developed for quantum query 
algorithms [TTl [12] to the problem of optimizing clock 
interrogations. This enables the greatest fiexibility in 
searching for solutions, as both the prior and the cost 
function can be arbitrary. The first major obstacle is 
that the unknown parameter of the queries is continu- 
ous rather than discrete and finite as in typical quantum 
query algorithms. We overcome this by showing how 
to systematically discretize the parameter spaces while 
having good control of the discretization errors. The sec- 
ond major obstacle is that the size of the semidefinite 
program (SDP) grows at a rate of 9 {tf\0\^{\Q\ + |F|)), 
where |0| is the number of points in our discretization, 
IQI is the number of atoms we are simulating, and |F| 
is the number of POVM elements. This limits the num- 
ber of atoms and the level of discretization for which 
general clock interrogations can be optimized, depend- 
ing on available computational resources. We show that 
for small but useful numbers of atoms, the SDPs can be 
implemented and solved given current resources. 

The semidefinite programming strategy is formu- 
lated in full generality in Sec. [TTj Our version does 
not restrict the set of possible queries or the prior 
over query parameters. We show how to explicitly 
reconstruct the algorithm and measurements from the 
solution and discuss how to modify the strategy to 
account for query noise. This may be of independent 
interest for interpolating between quantum and classical 
query complexity. In Sees. [Hi] and [IV| we specialize 
the SDPs to the case of quantum clocks. Here we 
show how to discretize the parameter spaces to obtain 
finite SDPs while bounding discretization errors. In 
Sec. [Vj we show the results from applying the dis- 



cretized SDPs to concrete clock problems. In particular 
we compare the computational results obtained to 
prior work, demonstrating both the ability to obtain 
improvements and to determine bounds on optimal costs. 



II. THE SEMIDEFINITE PROGRAMMING 

FORMULATION OF QUANTUM QUERY 

COMPLEXITY 

A. Constructing the Semidefinite Program 

The operation of a quantum clock can be expressed 
naturally in the query model of quantum computation. 
Here, we are given an oracle (or black box) chosen from 
some finite set {Q{1)^Q{2)...Q{M)}. Each oracle rt{x) is 
a unitary operator, selected with probability p{x). The 
goal is to determine x with queries, that is, with ap- 
plications of Q{x) to quantum states and measurement. 
Often in this context, one is interested in minimizing the 
number of queries needed to learn x with near certainty. 
Here, however, we fix the number of queries and seek to 
minimize the expected difference between an estimate x^ 
of X and x as quantified by a cost function C{x,x^). 

We adapt the semidefinite programming formulation 
of quantum query complexity developed by Barnum et 
al. [TTl [E] in the context of proving quantum lower 
bounds. They cast the problem of determining the num- 
ber of queries required in terms of a test of feasibility of 
a semidefinite program. Here we aim to minimize an ex- 
pected cost, which requires optimizing an objective func- 
tion with an extended SDP. For a general introduction 
to semidefinite programming see Ref. [13 . 

To formulate the SDP, we introduce quantum systems 
O and Q for the oracle and the querier, respectively. Sys- 
tem Q is the one on which the oracle operators Vt{x) 
act. An additional system of ancillas A may be used by 
the querier; for the purposes of the SDP, we normally 
trace out A. We use the convention that the systems 
on which an operator acts are denoted by superscripts. 
For states (density operators) p, partially omitted system 
superscripts imply the partial trace over the omitted sys- 
tems. Superscripts may be completely omitted if the set 
of systems being acted on is clear or irrelevant. The di- 
mension of the state space of system S is denoted by 
\S\. Initially, the state of the oracle system is given by 
Po = Ex Ej/ \/p{x)\/p{y)\x){y\. By representing the or- 
acle probabilities with a pure superposition, we encode 
the fact that there is no information about x available 
to the querier (or any system other than O). We define 
the joint operator QP^ = ^^ \x){x\Q^{x), which applies 
Q{x) to system Q conditional on the state \x) of the ora- 
cle. In this setting, a multi-query quantum computation 
is given by the composition 



I 



(6) 



followed by a measurement of QA with a POVM. Here 
p^^^(O) is the initial state, with p^(0) = po pure as de- 
fined above, and p^^(O) is a state chosen by the querier. 
The unitary operators U^^{t) are inter-query operators 
that can be chosen arbitrarily for each step t. The 
querier's protocol (or algorithm) is determined by the 
initial state p^^(O), the /7^^(t), and the POVM. Refs. 
[TTJ [12] show that there is a correspondence between 
these algorithms and solutions to a set of semidefinite 
constraints. We split the constraints into those that cor- 
respond to the initial state and choice of inter-query op- 
erators, and those that correspond to the POVM. The 
first set, Se^ consists of 

l.pO{0) = po, 

and the following for t G {0, 1, . . . , t/}: 

2. p^^{t) >0, 

3. p^{t) =trQ{p^^{t)) and 

4. p^{t) = trg(l]tOQpOQ(^ _ i^QOQy 

The constraints corresponding to the POVM and the 
objective to be optimized can be based on a connection 
to the concept of remote state preparation as described 
next. 



B. Measurement and Remote State Preparation 

Remote state preparation [14 involves two systems O 
and Q. Given a joint state of the two systems, we can 
prepare states of O conditional on measurements of Q. 

Definition 1. We say that we can remotely prepare 
Wa}a from the state p^^ on O and Q if there ex- 
ists a POVM of Q with operators {Pa} a such that 
trQ{P^pQO) = aO. 

The members <j^ of the set that can be remotely pre- 
pared are positive operators with trace < tr(cr^) < 1. 
The definition implies that the state cr^/tr(cr^) can be 
conditionally prepared with probability tr((T^) by means 
of a fixed POVM on Q. For definiteness, consider a 
POVM {P^}. Any implementation of the POVM has 
the desired effect. Such an implementation is described 
by a quantum operation with Kraus operators Ea such 
that E^Ea = Pa- For outcome a, the unnormalized OQ 
state is E^ p^^ E\^ . Cyclicity of partial trace implies 
that iiqE'^p^^El^ = tiqP^p^^ = a^ . The probabil- 
ity of the outcome is tr(cr^). 

Theorem [T] characterizes the set of states that can be 
remotely prepared according to Def. [ijfrom a pure state. 



Theorem 1. Let p^^ be a pure state of systems O 
and Q. We can remotely prepare {o-a}a ^/ ctrid only if 

The proof of Thm. [l]is given in App. [Aj 
In order to apply Thm. [l] we formulate the expected 
cost in terms of the POVM-conditional unnormalized 
states a^. In the clock problem, the querier associates 
an estimated frequency fa with each measurement out- 
come a. Assume for simplicity that the possible classi- 
cal oscillator frequencies cu come from a finite set. We 
can define operators A^ in the oracle basis {|cj)}u; by 
(^a)u;,u;' = ^uj,uj'C{uj — fa)- Eq. ^ cau be rewritten as 

{C) = J2tv{Aaaa). (7) 

a 

With this equation as motivation, we consider the general 
situation where the expected cost of a querier protocol is 
computed from predetermined cost operators Aa accord- 
ing to the POVM-conditional oracle states as in Eq. ^. 
This motivates the following SDP Sm{p^) for a given 
oracle state p^: 

Mmimize tr( > (JaAa) subject to: < ^ 

(8) 

Theorem 2. Suppose that p^^^ is pure. Then Sm{p^) 
computes the minimum expected cost over measurements 
on QA. 

Proof. It suffices to observe that according to Thm [l] 
sets {a a} a satisfying the constraints of Sm are precisely 
the sets that can be remotely prepared with access to 
systems QA. D 

The complete SDP for the query optimization problem 
is obtained by combining Sq = Se U 5'm(p^(^/))- Be- 
cause query algorithms have access to the non-0 systems 
of a purification of p^{tf), Sq computes the optimal av- 
erage cost of a t/-query quantum algorithm. The SDP 
considered in the spectral adversary method [TTJ [12] is 
a relaxation of Sq with a modified objective designed to 
determine a lower bound on the number of queries needed 
to obtain some fixed probability of error. There has been 
significant recent progress in refining this relaxation [15 
and demonstrating that it is nearly exact [16 . Note that 
in our case, we can construct cost operators Aa such that 
Sq minimizes the probability of error for fixed tf . 



C. Algorithm and POVM reconstruction 

For any solution of Sq^ in particular the optimal one, 
there is an explicit query algorithm that achieves the as- 



sociated cost objective. In particular, given the sequence 
of density matrices p^^{t) and the conditional operators 
aa, it must be possible to infer the sequence of unitaries 
in Eq. ([6| and the POVM achieving the expected cost. 
The POVM yielding the conditional operators aa can be 
constructed as in the proof of Thm. [l] To determine the 
unitaries U^^{t)^ first extend the querier system with an 
ancilla A, where A has dimension |0||(5|. For each t, con- 
struct pure states p'^^^{t) and p^^^(t + l) by purifying 
p'^^{t) = Q)^^p^^{t)Q.^^ and p^^(t + l), respectively. 
By construction, p'^{t) = p^(t + 1). One can therefore 
use the Schmidt forms for the pure states p'^^^{t) and 
pPQA(^^ + 1) to construct unitaries U^^{t) satisfying 



r^OQA 



(t + 1) = U^^{t)p^^^{t)U^'^^{t). (9) 



D. Noise 

The SDP Sq is based on the assumption that there is 
no noise in the query process. In particular, this excludes 
decoherence during clock queries. It is possible to adapt 
Sq to include the effects of noise. This requires that we 
extend the states p^^ by querier-inaccessible systems Ei 
modeling the environments causing the noise. The net 
effect of query and noise can be modeled by an oracle- 
conditional isometry defined by 



\x){y\pQ ^ \x){y\n{xf^pQ\e){e\^{y) 



fQE 



(10) 



where |x), \y) are the standard oracle basis states, |e) is 
a fixed initial state of E and Q{x)^^ is unitary. De- 
fine Q^^^ = V \x){x\Q{x)^^. In the absence of noise, 
Q{x)^^ _ (^x\ft^^\x). In many cases one can decompose 
n{x)^^ = D^^{x\n^^ (g) I^\x) for an 0-independent 
unitary D^^ . An example is the clock query in the pres- 
ence of phase decoherence. In a sequence of queries, a 
new version of ^, Ei is introduced at each step by the 
isometry. Let E* = E1E2 . . . Ef. To account for the noisy 
query, the SDP Sq is modified to Sd as follows: 

Minimize tr(^cr^^*^ A^) subject to 

a 

aO^'^ > 

b 

^^^'^(i) > 

(There is an implicit "for all" over the free variables a 
and t.) 

Phase decoherence is a particularly interesting exam- 
ple of this more general SDP. As mentioned above, for 



complete phase decoherence, the query isometry factors, 
in this case giving 



Z)<3^|i)'3|e)^ 



K)'^k.)^, 



(11) 



where the \ei) are orthonormal states. The effect is to 
perfectly correlate the environment at each step with the 
standard query basis. In the context of standard query 
algorithms with a cost function that captures the prob- 
ability of successfully identifying the oracle, the optimal 
solution to the SDP with complete phase decoherence 
corresponds to an optimal classical query algorithm for 
the given number of queries tf. By modifying D^^ to 
model incomplete phase decoherence, it is possible to 
interpolate between classical and quantum query algo- 
rithms, albeit at the large cost of adding the systems Ei. 
Note that it is not possible to simply trace out the 
Ei in the SDP: As can be seen from the method of re- 
constructing the algorithm from a solution of the SDP, 
this would be equivalent to giving the querier access to 
the Ei. That is, the querier has implicit access to any- 
thing that gets traced out, since traced out systems are 
not constrained by the SDP. When the noisy query fac- 
tors, this is equivalent to not having had any noise at all, 
because the querier can just undo the noise isometrics. 



III. THE CLOCK SDP 

One can apply the SDP Sq to the clock problem, but 
the result is not finitely implementable because the oracle 
system O is continuous and the cost operators are con- 
tinuously indexed. To make the SDP finite, we discretize 
both the possible oracle frequencies and the frequency es- 
timates that determine the cost operators. In particular, 
we constrain uo G {cJi, . . . ^uod}^ and restrict the measure- 
ment outcomes to a finite set a G {!,..., m} associated 
with the set of frequency estimates F = {/a}a=i,...,m- 
The frequency estimates need not be among the uji. The 
query system Q's Hilbert space is spanned by the Dicke 
states \k). The oracle initial state is given by 



p''{o) = Y,Jpi^x)p{^y)\^){yl 



(12) 



where p{uJx) is the prior probability of a;^;, a discretization 
of the continuous prior, and \x) is the oracle basis state 
corresponding to classical oscillator frequency ujx. The 
operator Q^^ is now given by 



n^Q = J2\x){x\eM-i-J?^.), 



(13) 



up to irrelevant x-dependent phases. As noted before 
Eq. ([7|), the cost operators are given by 



{Aa)x,y = C{uJa: - fa)S{x,y). 



(14) 



Since the SDP depends on p and F, we denote it by 
Sc{p-,F). We also use Sc{p-,F) to denote the optimum 



achievable cost given p and F. For discretized prior and 
frequency estimates, this is the cost computed by the 
SDR 

As written, the size of the SDP Sq is 
e(t/|0|2(|g|2 + |F|)), where F = {/J. Our im- 
plementation of the SDP takes advantage of the fact 
that for the clock problem, Q is diagonal in the Dicke 
basis, thus reducing the size and therefore the mem- 
ory and time resources required to solve the SDP. In 
particular, the set of solutions is invariant under the 
transformation p^^{t) -^ U {t)^ p^^ {t)U {t^^ for oper- 
ators U{t) diagonal in the Dicke basis. It follows that 
we can restrict the SDP by assuming p^(t) is diagonal. 
The restricted SDP's size is 6 (t/|Op(|Q| + |F|)). 



IV. DISCRETIZATION ERROR 

When solving the SDP, it is necessary to make an es- 
timate of the difference between the discretized SDP's 
optimal cost and that of the infimum of the costs of so- 
lutions to the continuous problem. We separately bound 
the error due to discretizing the prior {oracle discretiza- 
tion) and that due to discretizing the measurement out- 
comes {querier discretization). To deal with the oracle 
discretization error, we solve clock SDPs with random or- 
acle discretizations so that the average cost for different 
discretizations is a lower bound on the optimum cost of 
the continuous problem. An upper bound is obtained by 
a cost integral applied to any of the SDPs solved. For the 
quadratic cost function, the querier discretization error 
can be bounded in a way that depends only on the set 
F = {fa} a and can be made to go to zero by increas- 
ing the size and resolution of F. We start with querier 
discretization. 



A. Querier Discretization Error 

To guarantee that we determine the optimum cost for 
a frequency prior p, the set of allowed querier frequency 
estimates F should be all of R. To solve the clock SDP 
numerically, we restrict F to a finite subset. By defini- 
tion, Sc{p-,F) > S'c(j9, R). The goal of this section is to 
obtain a lower bound on S'c(p, R) depending on F, and 
to explain an iterative strategy for locally optimizing F. 
Let F = {/i, . . . , /at} with fj < fj^i. 

Theorem 3. Let C be a second differentiahle, non- 
negative function satisfying C"{x) < h, C(0) = and 
C is monotone on [0, oo) and (— oo,0]. Define M{uj) by 



M{uj) = < 



C(w- 


-/l) 


for to < fi 


C(w- 


-Jn) 


for u)> fN 







otherwise 



We have the following inequality: 

Scip^F) - Scip^R) < max^(/,+i - /,f 

J o 

+ / M{uj)p{uj)duj. (16) 

The proof is in App. |B] A strategy for obtaining an 
initial choice of an A^-point F is to optimize the right- 
hand-side of Eq. (16). 



An important question is how many frequency esti- 
mates fa are needed so that Sc{p^F) = 5'c(p, R). One 
can obtain an upper bound by observing that the rank r 
of the final oracle density matrix p^{tf) is bounded by 
IQI*^ and |0|, where \Q\ and \0\ are the dimensions of 
the query and oracle systems. From this one finds that 
the optimal POVM can always be reduced to at most r^ 
elements, implying that a set F with |F| < r^ suffices. 
There is evidence that a smaller set is optimal for the 
clock problem. For tf = 1 and for some costs and priors, 
we need only \F\ = r elements. [3 [17]. 

At present, we have no provably correct way of choos- 
ing the finite set of frequency estimates optimally. How- 



ever, for the quadratic cost function C{x) 



the 



following heuristic is often effective at optimizing the 
choices given an oracle discretization. We begin with 
any set of estimates. We then run the SDP and use the 
solution to compute the posterior distribution for each 
measurement outcome: 



P{^\fa) = 



p{fa,^) {cra)oj,i 



P{fa) tr(aa) ' 



(17) 



where the aa are the measurement-conditional unnormal- 
ized oracle states at the end of the algorithm. Next, we 
compute the mean of each of these distributions: 



{uj\a) 



^ tr(<7„) 



(18) 



where x indexes the finite set of frequencies and the ex- 
pression in angle brackets is the average of uj given that 
measurement outcome a was obtained. Replacing the 
original estimates fa by their posterior means is guar- 
anteed to improve the cost without having to change 
the algorithm. We then run the SDP again, replacing 
the frequency estimate fa with {uj\a). This procedure is 
repeated until each estimate is numerically close to its 
posterior mean. The procedure can be adapted to other 
costs, but the mean must be replaced by a statistic ap- 
propriate for the cost. For example, for C{x) = \x\ we 
compute the median instead of the mean. 



B. 



Oracle Discretization Error 



Let p{uj) be the probability density of the prior dis- 

U^y tribution of clock frequencies. For simplicity, we assume 

that the prior distribution is absolutely continuous with 



respect to Lebesgue measure. Let P{uj) be the cumula- 
tive distribution function of p(cj), and P~^ its inverse on 
(0,1). Given an offset o G (0, l/d), we can define the 
probabihty distribution 



cost if we are able to choose a different algorithm Qo for 
different choices of o, than if we are forced to use the 
same algorithm Qopt in all cases. We can continue from 
the last line of Eq. (23) as follows: 



Po(^) 



d-1 



^P-i(o+fe/d)(^)- 



(19) 



fc=0 



This is an instance of a discretized prior. Define cj(/c, o) = 
P~^{o-\-k/d). The distribution po is designed to approx- 
imate p diS d goes to infinity. If we choose o uniformly at 
random from (0, l/<i), it is identical to p. Specifically, 



nl/d 



Po{uj)p{o)do 



{C{Po, Qopt))o 

= ^ / C{uj - fa)q{a\uj, Qopt){Po{^))oduJ. 



(24) 



/ ^22 -j^u;ik,o){^)do = p{uj). (20) Combining Eqs. ([20]) , ([23]) , (IM then gives 



This follows from inverse transform sampling [18] (pg. 
28). 

To estimate the optimum cost Sc{p-,F)-, we estimate 
the average {Sc{po,F))oe{OMd) by solving Sc{Po,F) for 
a number of offsets o chosen uniformly at random from 
(0, l/(i). According to the next theorem, this gives a 
lower bound on Scip^ F). We assume that the frequency 
estimates have already been discretized, F = {fa}a- 

Theorem 4. The following inequality holds: 

{Sc{Po.F))o<Sc{p^F). 

Proof. Consider an arbitrary query algorithm Q. Given 
a prior r(co'), Q results in the measurement-conditional, 
unnormalized oracle states cra(r, Q). Because the cost 
operators are diagonal, we can consider just the diago- 
nals of the o-a{r^ Q), which define the joint probability 
distributions r{a,u\Q). Because the oracle operators are 
conditional on the standard oracle basis, r{a^uj\Q) fac- 
tors as 



r{a,uj\Q) = q{a\uj,Q)r{uj), 



(21) 



where, as indicated, the distribution q does not depend 
on r. 

The average cost for Q and r is given by 

C{r, Q)=J2 fc{oj- fa)r{a, oj\Q)dco. (22) 

a ^ 

If Qmin is an optimal algorithm for Sc{r,F), then for 
any algorithm Q, it follows that C(r, Q) > C{r^ Qmin) = 
Sc{t^F). Let Qo and Qopt be optimal algorithms for 
Sc{Po-,F) and Sc{p-,F)^ respectively. Then 



{Sc{Po,F))o = {C{Po,Qo))o 

< {C{Po, Qopt))o, 



(23) 



where the subscript on the expectations indicates that 
they are taken with respect to the distribution over off- 
sets o. The intuition here is that we can obtain a lower 



{Sc{Po,F)), <Y, [C{uj- fa)q{a\oj, Qo^,)p{uj)duj 

a •' 

= C{p,Qopt) = Sc{p,F), (25) 

proving the claim of the theorem. D 

We note that Thm. |4] generalizes to arbitrary oracle 
problems where the cost operators Aa are diagonal. Fur- 
thermore, the proof works for any family of probability 
distributions Po such that p is a mixture of the Po. 

Upper bounds on the optimal expected costs can be 
obtained by applying the inequality in the next Theorem. 

Theorem 5. Let Q be an algorithm for Sc{t^F). Then 
Sc{p. F)<Y,JC{UJ- fa)q{a\oJ, Q)p{uj)duj. (26) 

Proof The right-hand-side is the expected cost for al- 
gorithm Q given oracle prior p. Since Q is optimal for 
prior r but not necessarily for p, this must be greater 
than S'c(p, F), which is the optimum expected cost for 
prior p. D 

In view of the results of this section, we adopt the 
following procedure A{p^ F) for estimating a lower bound 
and calculating an upper bound of Scip-, F). 

1. Choose discretization parameter d and the number 
of random samples k. Large d should tighten the 
bounds. Large k improves the statistical estimate 
of the lower bound. 

2. Independently choose Oj G (0, l/<i), j G {1, . . . , /c} 
uniformly at random. 

3. Do the following for each j G {1, . . . , /c}: 

(a) Compute the optimum cost Cj = Sc{Poj^F), 
and from the SDP solution, reconstruct an op- 
timal algorithm Qj achieving this cost. 



(b) From Qj derive an algorithm for evaluating 

q{a\uj,Qj). 

(c) Using this algorithm, evaluate 

C] = Y,Jc{uj- fa)q{a\oJ, Q)p{oj)duj 



by numerical integration. 

4. Return ^ J]] • Cj as a statistical estimate of a lower 
bound (together with its estimated error) and 
m.mj{Cj) as a numerical upper bound. 



C. Procedure for Solving the Clock SDP 

Combining the ideas of this section, we use the follow- 
ing procedure for approximately solving the clock SDP 

1. Choose a discretization F, |F| = ?7i, of the fre- 
quency estimates. If the cost function is suitable. 



we can optimize the right-hand-side of Eq. 16 and 
let Cq be the corresponding querier discretization 
error bound. 

2. Apply procedure A{p^F) and let q be the statisti- 
cally estimated lower bound with estimated stan- 
dard error 5^, and Cu the numerical upper bound 
obtained. 

3. Give the estimated cost of 6'c(p, M) in the form 

((q - Cq) ±Si,Cu). 

If the cost function is not suitable, we set e^ = and 
describe the discretization F for which the bounds apply. 



V. RESULTS 

We begin by considering one-query clock protocols 
{tf = 1). In this case the protocol consists of an initial 
query state to be prepared and a final measurement. Fig- 
ures [2] and [3] illustrate the importance of taking into ac- 
count prior knowledge when deriving optimal clock pro- 
tocols. Here our technique is compared to that of Ref. [2], 
which derives protocols under the assumption that u is 
uniformly distributed on [— 7r,7r]. We consider Gaussian 
priors of various widths and see that solving the clock 
SDP can substantially reduce the expected cost. If we 
use the periodic cost function 4sin^( ^~^" ) considered 
in [2], in the limit of wide prior, we obtain identical pro- 
tocols. This is illustrated by Table [l| which lists initial 
2-atom states that optimize this cost function; the final 
row corresponds to the state computed in Ref. [2 . 

For computing the graphs of Figs. |2] and [3) and the ini- 
tial states in Table [ij we did not optimize the frequency 
estimates according to the iterative technique described 
at the end of Sect. |IV A In order to achieve sufficiently 



Standard Deviation 


|0) 


|1) 


|2) 


.25 


.7071 





.7071 


.75 


.5626 


.6058 


.5626 


1.25 


.5170 


.6823 


.5170 


1.75 


.5025 


.7035 


.5025 


2.25 


.5000 


.7071 


.5000 



TABLE I: Initial states that minimize the cost function C{oo- 



/a) = 4sin^( 



2(UJ-fa 



for one-query protocols assuming different 



width Gaussian priors. SDP parameters are identical to those 
of Fig. [2] 



small discretization error, we discretized the prior fre- 
quency distribution with 15 points and used 20 frequency 
estimates chosen by minimizing Eq. ( 16 ). The bounds are 



based on 100 random discretizations to obtain sufficiently 
good statistics on the lower bound. 

To verify the technique for obtaining error bounds, we 
compare our upper and lower bounds to the optimal so- 
lution obtained according to the formulas in Ref. [8 ; this 
is illustrated in Fig. [4j We use the optimal set of classi- 
cal frequency estimates derived in Ref. [8 ; therefore, in 
the continuous limit, the clock SDP and that of Ref. [8] 
should yield identical costs. Consequently, the deviation 
depicted in Fig. [4] is due entirely to discretization error 
and the limitations of our bounds. 

As discussed, our procedure can also optimize se- 
quences of two or more clock queries {tf > 2). If these 
queries are fully coherent, the algorithm is of the form 
given in Eq. Q, and the SDP implicitly optimizes the ini- 
tial state, the U{ti) and the measurement. Alternatively, 
we can combine the two queries classically. In this case we 
update our knowledge of the clock's phase using Bayes' 
rule between the queries. That is, after the ffrst query, 
we compute posterior distributions for each measurement 
outcome, as in Eq. (17). We then run the SDP again, 
once for each outcome, using the corresponding poste- 
rior distribution as the new prior. We compute a new 
cost by averaging each of the costs obtained, weighted 
by the probability of obtaining the corresponding mea- 
surement outcome, tr((Ja). Here we assume that there is 
no noise between sequential queries. Any noise would af- 
fect the intermediate prior distributions. Fig. |5] compares 
these two methods for a sequence of two queries with two 
atoms. Here we used |F| = 25 possible frequency esti- 
mates and the iterative technique described in Sect. |IV A 
for optimizing them. We found that the number of fre- 
quency estimates needed was substantially reduced af- 
ter optimization. For one query {tf = 1), and when 
such queries are combined classically, three estimates per 
query suffice after applying estimate optimization. When 
two queries are combined quantumly, five estimates suf- 
fice. It appears that, as expected, while we gain infor- 
mation by combining queries classically, fully coherent 
queries provide the greatest advantage. However, the 
technique developed for computing lower bounds cannot 
be applied to classical combinations of queries, so this 
advantage remains to be proven. 




1 1.5 

Standard Deviation 

(a) One atom 



1 1.5 2 

Standard Deviation 



(b) Two atoms 



FIG. 2: Comparison of the protocol derived in Ref. [2] and those derived by our method for one and two atoms and the cost 
function C{uj — fa) = 4sin^( ^~-^'^ ). We use a 15-point oracle discretization, 20 frequency estimates, and simulate Gaussian 
priors of various widths. The figures on the top plot the cost computed in Ref. [2 (dashed line) and our numerical upper bound 
(solid line), which as discussed, is equivalent to the minimum continuous cost obtained by one of our extracted algorithms. The 
figures on the bottom plot the difference between our lower bound and upper bound, q — Cu, illustrating both the strength of 
our bounds and how much lower the continuous cost could potentially be. The lower bound was computed by averaging 100 
discretizations; error bars show the estimated standard error of the average thus obtained. Our querier discretization bounds 
cannot be applied to the periodic cost function used here, so the lower bounds are for the discretizations chosen. The lines 
connecting the data points in our figures are to guide the eyes. 



Table [ll] examines the effect of adding more atoms to 
the clock. Additional atoms and additional queries al- 
ways provide an advantage, as can be seen by reading 
down the table. The far right column gives the compu- 
tational time required to run the SDP for a single dis- 
cretization on a quad core 2.8 GHz machine with 12 GiB 
of RAM. Note that we are able to simulate more atoms 
than Table |n| may imply. For example, a simulation of 
10 atoms using a uniform 15-point oracle discretization 
and tf = 1 was computed in 6 minutes, 3 seconds, and 
yields a cost of 0.0785. Computing bounds for a sys- 
tem of this size, however, would require a great deal of 
computational time. 

Notice that on the far right of Fig.lsFb), and in the last 
two rows of Table [TTj the gap between the lower bound 
and the upper bound becomes quite large. We need to 
increase the number of points in our discretizations if we 
wish to compute better approximations to the optimal 
solution for the continuous problem. This is as expected, 
since having more queries or atoms enables finer resolu- 
tion of oracle frequencies. Fig. |6] illustrates the effect on 
our bounds of increasing the number of points in the ora- 



cle discretization. Here we are reanalyzing the last point 
inFig.db). 

In summary, the method presented here is a general 
way of deriving better quantum clock protocols. Dis- 
cretization is necessary, but the error introduced can 



Number 


Number 


ci 


Cu 


si 


eg 


time 


of Atoms 


of Queries 










(min:sec) 


1 


1 


.6010 


.6321 


.0127 


.0152 


2:24 


2 


1 


.4083 


.4379 


.0109 


.0164 


2:33 


3 


1 


.2885 


.3263 


.0105 


.0177 


3:07 


4 


1 


.1974 


.2563 


.0045 


.0192 


2:46 


1 


2 


.4144 


.4379 


.0132 


.0164 


2:14 


2 


2 


.1957 


.2565 


.0047 


.0192 


3:35 


3 


2 


.1071 


.2119 


.0020 


.0229 


4:07 


4 


2 


.0902 


.2657 


.0022 


.0229 


4:58 



TABLE II: Costs for various combinations of atoms and 
queries for a Gaussian prior with a standard deviation of 1. 
SDP parameters are identical to those in Fig. [5] The times 
are given for solving one instance of the SDP. 100 instances 
were solved for the estimates of ci and Cu ■ 
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standard Deviation 
(a) Two atoms 



Standard Deviation 
(b) Four atoms 



FIG. 3: Comparison of the protocol derived in Ref. ^ and those derived by our method for two and four atoms and the cost 
function C(uj — fa) = (cj — /a)^. SDP parameters are identical to those in Fig. ^ The plots are also as in Fig. ^ except that 
for this cost function, we can compute querier discretization errors Cq. Thus, the lower plots show ci — Cu as dotted lines above 



the line for ci — Cu 



which gives the lower bounds for the continuous problem. 



be controlled. While the complexity of the SDPs to be 
solved limits the application of the method to small quan- 
tum systems, there are very promising atomic clocks, 
such as the ion-based ones, that use only a small number 
of atoms. 

The optimization strategy pursued here is greedy, tak- 
ing into account only the most recent prior. Therefore, it 
does not necessarily minimize long-term variance. Fur- 
ther research is required to develop more realistic strate- 
gies, taking advantage of knowledge of the clock's history. 

Finally, we note that the general form of the SDP and 
the discretization analysis given here can be used to ex- 
tend the adversary method to continuous, noisy, and clas- 
sical problems. It may also find applications to quantum 



parameter estimation problems other than phase or fre- 
quency estimation, where we wish to estimate the value 
of a parameter x of an arbitrary but known family of 
unitary operators U{x) that can be applied to quantum 
states of our choice. 
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Appendix A: Remote State Preparation 

Here we prove Thm. [l] 



1.4- 



1.2- 



-^0.8- 
co 
o 
O 
0.6- 

0.4- 

0.2- 




0.5 1 

Standard Deviation 



FIG. 5: Average cost after one query (top, dashed line), two 
queries combined classically (middle, dotted line), and two 
coherent quantum queries (bottom, solid line). We used a 15- 
point oracle discretization, |F| = 25, the cost function C{uj — 
fa) — {(jO — faY ^ and simulated two atoms. 




5 10 15 20 

Number of Points in Oracle Discretization 



25 



FIG. 6: Upper [cu^ dotted line) and lower (q, solid line) 
bounds on cost for oracle discretizations with varying numbers 
of points. We are simulating the last point of Fig. ^b) - that 
is, 4 atoms, a standard deviation of 1.875, and the quadratic 
cost function. The lower bound is computed by averaging 32 
random oracle discretizations. Note that the values in Fig. |3] 
are for a 15 point oracle discretization. 



Proof. Assume that we can remotely prepare {cr^} from 
p^^, and let {P^}a be the required POVM. Then 

Ea^a^ = EatrgPa^P^^ = trg(E,Pa)p^^ = P^, by 

the definition of a POVM. 

The converse is a generalization of the GH JW theorem 
[14 to mixed density operators. Suppose that ^^ cr^ = 
p^ . To construct the required POVM, first write each 
(j^ as an explicit mixture of pure states 



y^Pa,m|V^am)(V^a 



12 



By assumption, p^ = Ea,m^a,rn|V^a,m)(V^a,m|. By filling 
in mixture terms with Pa,m = if necessary, we can as- 
sume that the range of the index m is independent of a. 
Since p^^ = \^){^\ is pure, we can write the OQ state 
in Schmidt form 



\^) = ^V^\^j)\^j)^ 



(Al) 



where the |^j) and \(fj) are orthonormal in the Hilbert 
spaces of O and Q, respectively. Thus p^ can also be 
written as the mixture p^ = "^Zj Qj\^j){^j\' By unitary 
freedom (for example, see [19], pg. 103), 



ilV^am) = ^^g 



/^l^j). 



(A2) 



where the Uam,j are the entries of a unitary matrix. We 
can now define 

^^ = Y.Y.<m,J^-rnj'\^j){^rl (A3) 

That ^^ Pa = t follows from the unitarity condition for 
Uamj- To verify the partial trace condition, compute 



7P 



PQ 



trg \(pj){(pj'\'^^/mu\(t)i){(l)i'\\(pi){(pv 
\ 1,1' 

^Pam|V^am)(V^am| 



= cr. 



as desired. 



(A4) 

D 



Appendix B: Querier Discretization Bound 

Here is the proof of Thm. [3J 

Proof. Define C{p,Q) = Ea I ^iuJ - 9a)p{9a,oj\Q)dw, 
where the ga are Q's frequency estimates. Then C(p, Q) 
is the expected cost of Q given prior p. Let g{a) be de- 
fined by 

g{a) = argmin^ ( / C{uj - g)p{a\uj, Q)p{uj)duj j . (Bl) 

Then g{a) is the optimum frequency estimate Q could 
make given measurement outcome a. Let Qg be Q mod- 
ified to make the frequency estimates g{a). 

Let B be the expression on the right-hand-side of 
Eq. ([16|. We show that C{p,Qg) > Sc{p,F) - B for 
any algorithm Q. Since Sc{p-,^) = inf q C(p, Q) = 



infQC(p, Q^), the result follows. We prove the bound 
in two steps. In the first step we force the frequency esti- 
mates to lie in [/i, /at] and in the second we change them 
to lie in F. 

For the first step, let g{a) be the value in [/i,/Ar] 
nearest to g{a). If g{a) = g{a)^ then C{uj — g{a)) > 
C{uj - g{a)) - M{uj) since M{uj) > 0. If g{a) = /i, 
then one of the following holds: 1. cj > /i, in which 
case g{a) is nearer u and on the same side, so that 
C{uj - g{a)) > C{uj - g{a)) > C{uj - g{a)) - M{uj). 2. 
cj < /i, in which case C{uo — g{a)) > = C{uj — /i) — 
C'(a; — /i) = C{uj — g{a)) — M{uo). A similar argument 
works for g{a) = /at. Substituting the inequalities in the 
integral for C(p, Q) we get 

C{p,Qg) > Y, j C{uj-~g{a))p{a\uj,Q)p{uj)duj 

- ^ / M{uj)p{a\uj, Q)p{uj)duj 

a ^ 

= C{p,Q~g)- f M{,j)dcj. (B2) 

For the second step, we modify Qg to Q?, where f{a) 
is one of the elements of F on either side of g{a). That 
is, because /i < g{a) < /at, there exists a unique j such 
that fj < g{a) < /j+i, and we set f{a) to either fj or 
/,+i. Define A e [0,1] by g{a) = Xfj + (1 - A)/,+i. 
It is convenient to let Q i he a "mixed" (randomized) 

algorithm, where /(a) = fj with probability A and /j+i 
with probability 1 — A. Note that a mixed algorithm of 
this sort cannot be better than the optimal one, that is 
C{p,Qf) > Sc{p-,F). To bound the cost, we consider a 
given a and uo and estimate the quantity 

c{u,a) = XC{w-fj)^{l-X)C{w-fj^i) 
-C{oj-~g{a)) 
= X{C{w-f,)-C{u-~g{a))) 

^{l-X){C{w-f,^^)-C{u-~g{a))). 

(B3) 

Define ujq = uo — g{a), uoi = uo — /j+i and uju = ^ — fj- 
We can estimate 

C{uj)-C{uJo) = {uj - uJo)C\uJo) 

UJ — UJo pX 

C" {uoq + y)dydx 



/o ^0 

< {uj - UJq)C' {ujq) 

+ -{uj - ujQ^ la^yiC" {y) 



< {uj - UJq)C' {ujq) ^ -{uj - UJq)'^ . 



(B4) 
Substituting this bound for each summand of Eq. (|B3[) 



13 



gives 



+ (1 - X){{uji - uo)C\uo) + -{uji - cuof) 



{X{uju - UJof + (1 - X){uJi - uof)) 



2 



< 



2 



(B5) 



where we first applied Xuu -\- {I — X)uJi = uq. Tiie next 
identity requires applying (1 — A)(a;^ — cjq) = —X{uJu—CjOo) 
to the second summand, and the final inequality is ob- 
tained by noting that X{uJu—^o)/{fj-\-i—fj) is maximized 
at A = 1/2. We can apply the above inequalities to bound 



C{p^Qg) as follows: 



a ^ 



- max -(Z^+i - fjf)p{a\uj, Q)p{uj)duj 
J o 

= C{p, Qf) - max -(Z^+i - fjf 

> 5c(p,F)-max^(/,+i-/,)2. (B6) 

3 O 



To finish the proof, we combine Eqs. (B2) and (B6). D 



